The Peer-Reviewing Game
نویسندگان
چکیده
We model a family of peer-reviewing processes as gametheoretic problems. The model helps to understand elements of existing peer-reviewing procedures, and to predict the impact of new mechanisms. The peer-reviewing for evaluation of scientific results submitted to conferences involves complex decision processes of independent participants. Significant tax-payer money is spent by governments for the advancement of science, and such governmental decisions are often based on outcomes of peer-reviewing in scientific conferences. Here we propose to analyze and design improved mechanisms for conference peer-reviewing, based on gametheoretic approaches. Real world conference peer-reviewing processes are overly complex and here we define and analyze a simplified (toy) version, called the Peer-Reviewing Game. While our toy version may have significant assumptions, it provides an interesting game and a first step towards formalizing and understanding the real world problem. The players of this game are the researchers that participate as authors and reviewers. A funding agency tries to maximize the social value by providing rewards to researchers based on their publications. In this work the conference chair is assumed to be a trusted party, enforcing policies agreed by the funding agency and making publication decisions based on the recommendation of the reviewers. We uncover relations between Peer-Reviewing games and Prisoner’s Dilemma games. Examples of mechanisms are described and analyzed both theoretically and experimentally.
منابع مشابه
Game Theoretical Modeling and Studies of Peer-Reviewing Methods
We model a family of peer-reviewing processes as game-theoretic problems. This helps to understand elements of existing peer-reviewing procedures, and to predict the impact of new mechanisms. Real world conference peer-reviewing processes are overly complex and here we define and analyze simple versions. Our versions provides a contribution towards formalizing and understanding these complex re...
متن کاملApplication of a Heuristic Cybernetic Model in Peer-reviewing Process of Scholarly Papers
Background and Aim: This study attempts to show the cybernetics approach on peer reviewing articles to recommend an appropriate solution for increasing the qualitative level of published articles in scientific journals. Method: Heuristic Cybernetics method is suggested, based on the scientific experiences of related researches and also the mathematical principles that is an appropriate formed s...
متن کاملFun and games in reviewing neonatal emergency care.
OBJECTIVE To develop a game-based review instrument for use by newborn caregivers in preparing for emergency situations. DESIGN One hundred and one test questions covering pathophysiology, resuscitation, and medications were developed. The questions then underwent expert and peer review, psychometric testing for content validity and test-retest reliability, and a game trial. ANALYSIS The ne...
متن کاملConference Report: Open Peer-Review Experiment in the Decentralized Coordination Workshop
Game theory is a powerful tool that can be used to model, analyze, and compare complex social interactions. If one can formalize and quantify motivations in terms of concrete utility values, then one can predict the behavior of the society under the assumption of rational participants. Moreover, one can simulate the impact of new regulations. Peer-reviewing is an important social activity, whos...
متن کامل